Questions Feature Extraction and Semi- supervised Classification Based on Terms Relevance

نویسندگان

  • Quan Zhao
  • Zhengtao Yu
  • Lei Su
  • Jianyi Guo
  • Yu Mao
چکیده

Question classification, an important component of question answering systems, has a direct impact on the answer extraction accuracy. In this paper, a question classification method is proposed by combined the question feature extracting of term relevance with semi-supervised classification. In detail, the method extracts structure terms in interrogative sentences as the feature space through statistical means, and calculates the relevance among terms by literal similarity method, besides, feature vectors of question classification are obtained by using term similarity relationship to build the questions’ feature value in feature space. And then, utilizing unlabeled samples classify questions with the help of Co-training style and semisupervised learning algorithm. Experimented on 20,000 questions in Yunnan tourism domain, the results show that more remarkable effects have been achieved by adopting the method above. The classification accuracy rate reaches 82.34%, which is higher than the TFIDF feature extraction methods and supervised learning methods by 15.4 percentage points and 1.4 percentage points separately.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

کاهش ابعاد داده‌های ابرطیفی به منظور افزایش جدایی‌پذیری کلاس‌ها و حفظ ساختار داده

Hyperspectral imaging with gathering hundreds spectral bands from the surface of the Earth allows us to separate materials with similar spectrum. Hyperspectral images can be used in many applications such as land chemical and physical parameter estimation, classification, target detection, unmixing, and so on. Among these applications, classification is especially interested. A hyperspectral im...

متن کامل

Overlap-based feature weighting: The feature extraction of Hyperspectral remote sensing imagery

Hyperspectral sensors provide a large number of spectral bands. This massive and complex data structure of hyperspectral images presents a challenge to traditional data processing techniques. Therefore, reducing the dimensionality of hyperspectral images without losing important information is a very important issue for the remote sensing community. We propose to use overlap-based feature weigh...

متن کامل

Supervised Feature Extraction of Face Images for Improvement of Recognition Accuracy

Dimensionality reduction methods transform or select a low dimensional feature space to efficiently represent the original high dimensional feature space of data. Feature reduction techniques are an important step in many pattern recognition problems in different fields especially in analyzing of high dimensional data. Hyperspectral images are acquired by remote sensors and human face images ar...

متن کامل

Audio Genre Classification with Semi-Supervised Feature Ensemble Learning

Widespread availability and use of music have made automated audio genre classification an important field of research. Thanks to feature extraction systems, not only music data, but also features for them have become readily available. However, handlabeling of a large amount of music data is time consuming. In this study, we introduce a semi-supervised random feature ensemble method for audio ...

متن کامل

Hyperspectral Image Classification Based on the Fusion of the Features Generated by Sparse Representation Methods, Linear and Non-linear Transformations

The ability of recording the high resolution spectral signature of earth surface would be the most important feature of hyperspectral sensors. On the other hand, classification of hyperspectral imagery is known as one of the methods to extracting information from these remote sensing data sources. Despite the high potential of hyperspectral images in the information content point of view, there...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2009